Augmented reality replica of missing device interface

ABSTRACT

A method for replicating interfaces in augmented reality for missing devices is provided. A processor identifies an expected position pattern of one or more wearable devices in conjunction with an augmented reality device based on an expected usage pattern of a user. A processor compares a current position pattern of the one or more wearables user to the expected position pattern. In response to the current position pattern not matching the expected position pattern, a processor retrieves an overlay corresponding to a use case indicated by the expected usage pattern. A processor renders the overlay in the augmented reality device, where the overlay is rendered in the expected position pattern for the one or more wearable devices relative to a view of the augmented reality device.

BACKGROUND OF THE INVENTION

The present invention relates generally to the field of augmentedreality, and more particularly to detecting a missing device andreplicating an interface within the augmented reality.

Augmented reality (AR) is the modification of a real-world environmentwith computer-generated information. Typically, a head mounted display(HMD) or smart glasses are worn by a user, permitting the user to seethe real-world environment in addition to computer-generated informationthat is overlayed or displayed upon the user's view of the real-worldenvironment. In this way, augmented reality alters or improves a user'sperception of a real-world environment, whereas virtual realitytypically replaces the user's real-world environment with a simulatedone.

SUMMARY

Embodiments of the present invention provide a method for replicatinginterfaces in augmented reality for missing devices. A processoridentifies an expected position pattern of one or more wearable devicesin conjunction with an augmented reality device based on an expectedusage pattern of a user. A processor compares a current position patternof the one or more wearables user to the expected position pattern. Inresponse to the current position pattern not matching the expectedposition pattern, a processor retrieves an overlay corresponding to ause case indicated by the expected usage pattern. A processor rendersthe overlay in the augmented reality device, where the overlay isrendered in the expected position pattern for the one or more wearabledevices relative to a view of the augmented reality device.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a functional block diagram illustrating a personal areanetworked (PAN) environment, in accordance with an exemplary embodimentof the present invention.

FIG. 2 illustrates operational processes of an augmented realityinterface program, on a computing device within the environment of FIG.1 , in accordance with an exemplary embodiment of the present invention.

FIGS. 3A and 3B depict an example scenario of replicating an interfaceof a missing device within a user's personal area network.

FIG. 4 depicts a block diagram of components of the computing deviceexecuting an augmented reality interface program, in accordance with anexemplary embodiment of the present invention.

DETAILED DESCRIPTION

The present invention may be a system, a method, and/or a computerprogram product at any possible technical detail level of integration.The computer program product may include a computer readable storagemedium (or media) having computer readable program instructions thereonfor causing a processor to carry out aspects of the present invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, configuration data for integrated circuitry, oreither source code or object code written in any combination of one ormore programming languages, including an object oriented programminglanguage such as Smalltalk, C++, or the like, and procedural programminglanguages, such as the “C” programming language or similar programminglanguages. The computer readable program instructions may executeentirely on the user's computer, partly on the user's computer, as astand-alone software package, partly on the user's computer and partlyon a remote computer or entirely on the remote computer or server. Inthe latter scenario, the remote computer may be connected to the user'scomputer through any type of network, including a local area network(LAN) or a wide area network (WAN), or the connection may be made to anexternal computer (for example, through the Internet using an InternetService Provider). In some embodiments, electronic circuitry including,for example, programmable logic circuitry, field-programmable gatearrays (FPGA), or programmable logic arrays (PLA) may execute thecomputer readable program instructions by utilizing state information ofthe computer readable program instructions to personalize the electroniccircuitry, in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a computer, or other programmable data processing apparatusto produce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks. These computerreadable program instructions may also be stored in a computer readablestorage medium that can direct a computer, a programmable dataprocessing apparatus, and/or other devices to function in a particularmanner, such that the computer readable storage medium havinginstructions stored therein comprises an article of manufactureincluding instructions which implement aspects of the function/actspecified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the blocks may occur out of theorder noted in the Figures. For example, two blocks shown in successionmay, in fact, be accomplished as one step, executed concurrently,substantially concurrently, in a partially or wholly temporallyoverlapping manner, or the blocks may sometimes be executed in thereverse order, depending upon the functionality involved. It will alsobe noted that each block of the block diagrams and/or flowchartillustration, and combinations of blocks in the block diagrams and/orflowchart illustration, can be implemented by special purposehardware-based systems that perform the specified functions or acts orcarry out combinations of special purpose hardware and computerinstructions.

The present invention will now be described in detail with reference tothe Figures. FIG. 1 is a functional block diagram illustrating personalnetwork environment, generally designated 100, in accordance with oneembodiment of the present invention. Personal network environment 100includes augmented reality (AR) device 110 and wearable device(s) 120a-n connected over network 130. AR device 110 includes AR interfaceprogram 112, pattern module 113, position module 114, usage data 115,position data 116, and interface data 117. Wearable device(s) 120 a-ninclude a respective user program 122 a-n.

In various embodiments of the present invention, AR device 110 andwearable device(s) 120 a-n are each a computing device that can be astandalone device, a server, a laptop computer, a tablet computer, anetbook computer, a personal computer (PC), or a desktop computer. Inanother embodiment, AR device 110 or wearable device(s) 120 a-n eachrepresent a computing system utilizing clustered computers andcomponents to act as a single pool of seamless resources. In general, ARdevice 110 and wearable device(s) 120 a-n can be any computing device ora combination of devices with access to pattern module 113, positionmodule 114, usage data 115, position data 116, and interface data 117and is capable of executing AR interface program 112 and user program(s)122. AR device 110 and wearable device(s) 120 a-n may include internaland external hardware components, as depicted and described in furtherdetail with respect to FIG. 4 .

In this exemplary embodiment, AR interface program 112, pattern module113, position module 114, usage data 115, position data 116, andinterface data 117 are stored on AR device 110. User program(s) 122 a-nare stored on a respective wearable device(s) 120 a-n. However, in otherembodiments, AR interface program 112, pattern module 113, positionmodule 114, usage data 115, position data 116, interface data 117 anduser program(s) 122 a-n may be stored externally and accessed through acommunication network, such as network 130. Network 130 can be, forexample, a local area network (LAN), a wide area network (WAN) such asthe Internet, or a combination of the two, and may include wired,wireless, fiber optic or any other connection known in the art. Ingeneral, network 130 can be any combination of connections and protocolsthat will support communications between AR device 110 and wearabledevice(s) 120 a-n, in accordance with a desired embodiment of thepresent invention.

In various embodiments of the present invention, a user is in possessionof an augmented reality (AR) device 110 and one or more wearable devices120 a-n. The AR device 110 and the one or more wearable devices 120 a-nare connected via network 130. In various embodiments, network 130 is apersonal area network (PAN) that utilizes various PAN and other ad-hocnetworking protocols to communicate with one another; such as, but notlimited to, BLUETOOTH®, Wireless PAN, Wireless Ad-hoc Network (WANET),and the like. In some scenarios, network 130 may also support othercommunications standards and permit communication with AR device 110 andthe one or more wearable devices 120 a-n, as well as any other devicethat can connect to network 130.

AR interface program 112 provides various features and functions thataugment a user's perception of a real-world environment. AR device 110is any device that displays or overlays information in a user's view ofthe surroundings of the user. For example, AR device 110 is a set ofsmart glasses that include a camera that projects AR information ontothe lenses of the smart glasses. Example AR devices 110 include, but arenot limited to, heads-up displays and other panels with transparentdisplay surfaces for projecting AR information, projectors and otherimage displaying devices that can project AR information onto surfaces,or any device that can overlay, project or otherwise displaycomputer-generated information within a user's view.

In various embodiments, AR interface program 112 monitors usage patternsand position patterns of wearable devices 120 a-n. For example, a userhas a smartwatch and a mobile phone (e.g., wearable device 120 a and 120b) in addition to AR device 110. AR interface program 112 monitors andrecords the times that a user wears or otherwise utilizes the wearabledevice. As discussed herein, wearable device includes numerous smartdevices such as smartwatches, that a user wears on their body.Additionally, wearable device may also include any smart device, such asa smartphone, that a user carries around on their person. As usedherein, wearable device is any portable device that a user carries withthem or wears on their person. Wearable device is any device that canconnect to network 130 and communicate with AR device 110.

During the monitoring phase, AR interface program 112 determines whichdevices are worn or carried by the user, in addition to the time andgeographical locations that the devices are worn or carried. Patternmodule 113 retrieves time and geolocation data during a user'sactivities. Pattern module 113 generates usage data 115 of when andwhere a user frequently uses wearable devices 120 a-n in conjunctionwith AR device 110. Pattern module 113 also monitors and identifies whenwearable devices 120 a-n are used in conjunction with other tasks andoperations of both AR device 110 and other wearable devices 120 a-n. Forexample, a user routinely uses the speaker in a smart watch when takinga call. Pattern modules 113 identifies that both the “Call” operation ofthe smartphone co-occurs frequently with connecting the speaker of thesmartwatch. In such situations, AR interface program 112 determines thatthe co-occurrence of both frequently coincide in order to determinefrequent pairings of wearable worn by the user, in addition to otherusage patterns such as time/day and geographical locations when worn.

In various embodiments, AR interface program 112 determines the relativepositions of AR device 110 and wearable devices 120 a-n as the userwears or carries the devices. In some scenarios, AR device 110 includesa forward-facing camera that captures images of the user' view. Based onmachine vison applied to the captured images, AR interface program 112determines the locations of the person that AR device 110 and wearabledevices 120 a-n typically reside. In other scenarios, AR interfaceprogram 112 retrieves a signal strength of wireless communications inthe user's PAN 130. Based on the signal strength and known deviceoperation characteristics (e.g., broadcast signal strength orsignal-to-noise gain), AR interface program 112 determines anapproximate distance between AR device 110 and wearable devices 120 a-n.In some instances, AR interface program 112 determines a latency betweencommunicating devices in PAN 130, determining a distance between devicesbased on the time messages or packets take to be sent and receivedbetween AR device 110 and wearable devices 120 a-n. In variousembodiments, based on the retrieved data, AR interface program 112records position data for both the AR device 110 and wearable devices120 a-n.

Based on the position and/or distances determined by AR interfaceprogram 112 of the AR device 110 and wearable devices 120 a-n, ARinterface program 112 generates a three-dimensional vector mapping of ARdevice 110 and wearable devices 120 a-n within a three-dimensionalspace. An example vector map is discussed in detail in regard to FIGS.3A and 3B. The vector map provides AR interface program 112 with amapping of positions for AR device 110 and wearable devices 120 a-n onthe user's person. The vector map includes relative positions of eachdevice that has been monitored to be used by the user. The vector mapindicates not only where a device is located but also the direction inwhich the device faces. For example, a smart watch may be worn on theleft wrist of a user, but also can be worn with the display facinginwards or outwards from the wrist. The vector map denotes not only theposition but the expected direction the device is typically worn.

For a variety of usage patterns (e.g., different sets of wearables areused at different times or scenarios), AR interface program 112generates different vector maps for the different identified usagescenarios. For example, a user may wear a smartwatch on the inside ofthe wrist when swimming or exercising and the turn the watch to theoutside of the wrist when at work. For each identified usage pattern, ARinterface program 112 generates a vector map that indicates the relativelocation and position of AR device 110 and wearable devices 120 a-n.

In various embodiments, AR interface program 112 compares current usageand position information to the historic patterns in usage data 115 aswell as corresponding position data 116 identified during the historicpatterns of use observed by AR interface program 112. If the user beginsa certain usage pattern or is otherwise expected to do so at a giventime or location, then AR interface program 112 checks that the currentposition information of AR device 110 and wearable devices 120 a-nmatches previous usage patterns. For example, if a user leaves eachweekday around 9 AM and carries a smart phone and smart watch, inconjunction with AR device 110, then AR interface program 112 checks toensure the smart phone and smart watch are in the expected position asindicated by historic position data 116.

In some embodiments, AR interface program 112 notifies the user that awearable device 120 a-n is not located in the expected position. If thedevice is not in its expected position, AR interface program 112generates an overlay notification that indicates the missing device. Insome scenarios, the notification is overlayed as a positionalnotification which displays a message in an approximate location of themissing device (e.g., from the user's view of AR device 110, ARinterface program 112 projects a visual notification in a display areaof the AR device 110 that corresponds to the expected location of themissing device.

In various embodiments, AR interface program 112 generates a virtualinterface corresponding to a missing device. When usage data 115 andposition data 116 indicate that a wearable device is missing orotherwise not in an expected position based on historic usage, ARinterface program 112 generates a virtual interface overlay at theexpected position, relative to the display driver of AR device 110 andthe user's augmented view. Therefore, when AR interface program 112detects a missing or incorrect position for a wearable device, AR device110 will provide a virtual interface that mimic some or all of thefunctionality of the wearable device.

For example, if usage patterns indicate that a user often uses a smartwatch to change music tracks on playing a smart phone during a jog at apark, but current position data 116 indicates the smart watch is notconnected to PAN 130, then AR interface program 112 displays a musiccontrol interface in the approximate position of the smart watch. Asanother example in the same scenario, the jogger is wearing the smartwatch on the inside of the wrist, but typically run with the watch turnto the outside of the wrist. In this scenario, AR interface program 112determines the position data 116 does not match since the vectors fromthe display point to opposite sides of the wrist from where the watch isexpected to be in position. In this scenario, AR interface program 112renders the overlay when the user is viewing the outside portion oftheir wrist, saving the user the effort of flipping the watch tointeract with the music player interface displayed on the smart watch.

In various embodiments, AR interface program 112 retrieves interfacedata 117 which includes various AR interfaces that can be overlayed ordisplayed by AR device 110 when a wearable device 120 a-n is notdetected to be in an expected position based on usage patterns.Interface data 117 includes AR overlay interfaces that mimic thefunctionality of the device or a function of the missing device. Forexample, interface data 117 includes a repository of AR interfaces thatcorrespond with known devices, such as a brand of smart watches. Asanother example, interface data 117 includes various functionalinterfaces that do not correspond to a specific device, per se, but tospecific functions typical of the type of device (e.g., a music playercontrol interface or a home automation interface).

By identifying missing or incorrectly placed wearable devices based onprior usage patterns of a user, embodiments of the present inventionprovide for an uninterrupted user experience when interacting withvarious smart devices in conjunction with AR device 110, even if thecontrol device typically used in not present. While generating userinterfaces in AR is known, prior AR interfaces do not selectively enablewhen a device is not present but expected to be used. By monitoring notonly usage data, but also the expected position of the missing device,embodiments of the present invention can identify when devices aremissing and overlay an equivalent interface, in an augmented view, at alocation the user expects the interface to be located based on priorusage.

FIG. 2 illustrates operational processes, generally designated as 200,of augmented reality (AR) interface program 112. In process 202, ARinterface program 112 collects usage patterns of wearables devices 120a-n (i.e., usage data 115) as well as positioning data (i.e., positiondata 116) of wearables devices 120 a-n. Usage patterns may include, butnot limited to, the following usage patterns: the combinations ofwearables a user utilizes (e.g., that a smart watch and smart phone aretypically used in combination or worn at similar times), locations wherewearables are used (e.g., at home a smart watch is rarely used, but theuser wears the smart watch more frequently when they leave for work),and time or dates that the wearables are used (e.g., a smart watch isused only on weekends). Additionally, AR interface program 112 alsocollects positioning data of the wearables to create a historic mappingof where wearables 120 a-n a typically placed of the user's person, aswell as the orientation or direction wearables 120 a-n are facing.

In process 204, AR interface program 112 generates a 3-D map of wearableusage patterns and positions. For each usage pattern detected in process202, AR interface program 112 generates a 3-D vector map that indicatesthe location and position of AR device 110 and any wearables 120 a-nthat associated with the specific usage pattern. For example, ARinterface program 112 determines two usage patterns based on datacollected in process 202, one for weekdays and another for weekends. Onweekends the user typically wears a smart ring and on weekdays the usercarries a smart phone and smart watch. In this example, AR interfaceprogram 112 generates a 3-D vector map indicating the expected locationand position relative to AR device 110. As such for each usage pattern,AR interface program 112 knows the expected place the wearable should belocated on the user's person. Additionally, AR interface program 112generates vectors between each wearable such that a complete mapping ofAR device 110 and relative position for each wearable 120 a-n for anyusage pattern can be used in predicting the expected wearables in agiven scenario, as well as where each wearable should be locatedrelative to each other as well as AR device 110.

In process 206, AR interface program 112 retrieves the current wearabledevice arrangement that a user currently is carrying on them as well ascurrent environmental data. As previously discussed, AR interfaceprogram 112 can determine the distance and position each wearable 120a-n is at relative to AR device 110, such as based on signal strength ormachine vision from input from a camera connected to AR device 120. Thepresence of the wearables could also be determined based on an activecommunication channel between AR device 120 and wearables 120 a-n.Environmental data relates to the current times, location and otherusage pattern conditions that AR interface program 112 collects andtracks in process 202.

In process 208, AR interface program 112 compares the current wearabledevice arrangement and environmental data to the historic usage patternsand positioning of wearables 120 a-n. If a user is not wearing awearable (or the wearable is not positioned in its expected position)for a given usage pattern, then AR interface program 112 determines thecurrent wearable arrangement is missing a wearable (YES branch ofdecision process 210). If a wearable is positioned incorrectly ormissing, then AR interface program 112 renders an interface for thewearable, or at least an interface for a common usage of the wearable(e.g., a music player control interface if the user commonly uses awearable to skip music tracks). The rendered interface is projectedwithin the augmented view of the user such that it appears to the userin approximately the same location and position of the missing wearable.As such, AR interface program 112 can still provide some or allfunctionality of the missing wearable. In some embodiments, AR interfaceprogram 112 may alert the user of the missing wearable when anydeviation is determined in process 208 from historic usage patterns.

While rendering the AR interface for the missing wearable, AR interfaceprogram 112 monitors gestures and other inputs from the user to interactwith the overlay interface for the missing wearable. Based on the designof interface data 117, various hand and other bodily gestures can beperformed by the user to perform operations previously accomplished bythe missing wearable. For example, a swiping motion with the left handof the user may skip tracks in a music player interface. In variousembodiments, AR interface program 112 continuously compares the currentwearable arrangement to historic usage data 115 and position data 116.If the user or environmental data changes usage patterns, then ARinterface program 112 checks to see if a wearable is missing for thechange in usage patterns. If a user has the expected wearables 120 a-nbased on historic usage patterns and positioning (NO branch of decisionprocess 210), then disables any AR interface rendered in process 214.

FIGS. 3A and 3B depict example scenarios, with both generally designated310 and 320, respectively, of replicating an interface of a missingdevice within a user's personal area network. In scenario 310, ahistoric usage pattern and position is depicted. In scenarios 310, theuser typically looks at smart watch 316 while talking to contacts onsmart phone 314. During scenarios 310 and 320, the user is wearing ARdevice 312, which is a pair of smart glasses with a projector to displayaugmented information on top of the user's view. As discussed herein, ARinterface program 112 generates a vector map, comprising vectors V1, V2and V3, which indicate the expected location and position of AR device312, smart phone 314 and smart watch 316.

Scenario 320 depicts a scenario where the user has forgotten to wearsmart watch 316. Based on historic usage patterns, when the user engagesa phone call in scenario 320 on smart phone 314, AR interface program112 checks to see if smart watch is in the expected location andposition based on vector mapping V2 or V3. If the watch is in adifferent location (e.g., not worn or on the other wrist) during thisusage pattern, then AR interface program 112 generates interface overlay322 within the display of AR device 312. Vector mappings V2 and V3 areused to properly project interface overlay 322 within the users view ofthe lenses of AR device 312. While interface overlay 322 is depicted onthe user's wrist, one of ordinary skill in the art will understand thatinterface overlay 322 is displayed within the user's view and is avirtual interface that appears to the user to be located on the expectedwrist that smart watch 316 usually is worn.

FIG. 4 depicts a block diagram, 400, of components of AR device 110 andwearable device(s) 120 a-n, in accordance with an illustrativeembodiment of the present invention. It should be appreciated that FIG.4 provides only an illustration of one implementation and does not implyany limitations with regard to the environments in which differentembodiments may be implemented. Many modifications to the depictedenvironment may be made.

AR device 110 and wearable device(s) 120 a-n each include communicationsfabric 402, which provides communications between computer processor(s)404, memory 406, persistent storage 408, communications unit 410, andinput/output (I/O) interface(s) 412. Communications fabric 402 can beimplemented with any architecture designed for passing data and/orcontrol information between processors (such as microprocessors,communications and network processors, etc.), system memory, peripheraldevices, and any other hardware components within a system. For example,communications fabric 402 can be implemented with one or more buses.

Memory 406 and persistent storage 408 are computer-readable storagemedia. In this embodiment, memory 406 includes random access memory(RAM) 414 and cache memory 416. In general, memory 406 can include anysuitable volatile or non-volatile computer-readable storage media.

AR interface program 112, pattern module 113, position module 114, usagedata 115, position data 116, interface data 117 and user program(s) 122a-n are stored in persistent storage 408 for execution and/or access byone or more of the respective computer processors 404 via one or morememories of memory 406. In this embodiment, persistent storage 408includes a magnetic hard disk drive. Alternatively, or in addition to amagnetic hard disk drive, persistent storage 408 can include a solidstate hard drive, a semiconductor storage device, read-only memory(ROM), erasable programmable read-only memory (EPROM), flash memory, orany other computer-readable storage media that is capable of storingprogram instructions or digital information.

The media used by persistent storage 408 may also be removable. Forexample, a removable hard drive may be used for persistent storage 408.Other examples include optical and magnetic disks, thumb drives, andsmart cards that are inserted into a drive for transfer onto anothercomputer-readable storage medium that is also part of persistent storage408.

Communications unit 410, in these examples, provides for communicationswith other data processing systems or devices, including resources ofnetwork 130. In these examples, communications unit 410 includes one ormore network interface cards. Communications unit 410 may providecommunications through the use of either or both physical and wirelesscommunications links. AR interface program 112, pattern module 113,position module 114, usage data 115, position data 116, interface data117 and user program(s) 122 a-n may be downloaded to persistent storage408 through communications unit 410.

I/O interface(s) 412 allows for input and output of data with otherdevices that may be connected to AR device 110 and wearable device(s)120 a-n. For example, I/O interface 412 may provide a connection toexternal devices 418 such as a keyboard, keypad, a touch screen, and/orsome other suitable input device. External devices 418 can also includeportable computer-readable storage media such as, for example, thumbdrives, portable optical or magnetic disks, and memory cards. Softwareand data used to practice embodiments of the present invention, e.g., ARinterface program 112, pattern module 113, position module 114, usagedata 115, position data 116, interface data 117 and user program(s) 122a-n, can be stored on such portable computer-readable storage media andcan be loaded onto persistent storage 408 via I/O interface(s) 412. I/Ointerface(s) 412 also connect to a display 420.

Display 420 provides a mechanism to display data to a user and may be,for example, a computer monitor, or a television screen.

The programs described herein are identified based upon the applicationfor which they are implemented in a specific embodiment of theinvention. However, it should be appreciated that any particular programnomenclature herein is used merely for convenience, and thus theinvention should not be limited to use solely in any specificapplication identified and/or implied by such nomenclature.

What is claimed is:
 1. A method comprising: identifying, by one or moreprocessors, an expected position pattern of one or more wearable devicesbased on historic position data of a user regarding the one or morewearable devices; identifying, by the one or more processors, anexpected usage pattern of the one or more wearable devices based onhistoric usage data of the user regarding the one or more wearabledevices, wherein historic usage data indicates one or more of thefollowing: a combination of the one or more wearable devices that areutilized in the historic usage patterns, locations where the one or morewearable devices are utilized in the historic usage patterns, and datesor times where the one or more wearable devices are utilized in thehistoric usage patterns; in response to a determination that a currentusage pattern of a user is indicative of the expected usage patterns ofthe one or more wearable devices, comparing, by the one or moreprocessors, a current position pattern of the one or more wearablesdevices to the expected position pattern; in response to the currentposition pattern not matching the expected position pattern, retrieving,by the one or more processors, an overlay corresponding to a use caseindicated by the expected usage pattern; and rendering, by the one ormore processors, the overlay in the augmented reality device, whereinthe overlay is rendered in the expected position pattern for the one ormore wearable devices relative to the view of an augmented realitydevice.
 2. The method of claim 1, wherein the expected position patternis a vector-based map that indicates an expected position and anexpected direction of the one or more wearable devices.
 3. The method ofclaim 2, wherein comparing the current position pattern of the one ormore wearables devices to the expected position pattern furthercomprises: comparing, by the one or more processors, a current positionof the one or more wearables to the expected position indicated by thevector-based map; and comparing, by the one or more processors, acurrent direction of the one or more wearables to the expected directionindicated by the vector-based map.
 4. The method of claim 1, the methodfurther comprising: identifying, by the one or more processors, amissing wearable device based on the comparison of the current positionpattern of the one or more wearables devices to the expected positionpattern; retrieving, by the one or more processors, an augmented realityoverlay interface associated with the missing wearable device; andrendering, by the one or more processors, the augmented reality overlayinterface associated with the missing wearable device.
 5. The method ofclaim 1, the method further comprising: identifying, by the one or moreprocessors, a missing wearable device based on the comparison of thecurrent position pattern of the one or more wearables devices to theexpected position pattern; retrieving, by the one or more processors, anaugmented reality overlay interface associated with a function of themissing wearable device; and rendering, by the one or more processors,the augmented reality overlay interface associated with the function ofthe missing wearable device.
 6. The method of claim 1, wherein thecurrent position pattern is determined based on at least one imagecaptured by the augmented reality device.
 7. The method of claim 1,wherein the current position pattern is determined based on a respectivesignal strength of a connection between the one or more wearable devicesand the augmented reality device.
 8. A computer program productcomprising: one or more computer-readable storage media and programinstructions stored on the one or more computer-readable storage media,the program instructions comprising: program instructions to identify anexpected position pattern of one or more wearable devices based onhistoric position data of a user regarding the one or more wearabledevices; program instructions to identify an expected usage pattern ofthe one or more wearable devices based on historic usage data of theuser regarding the one or more wearable devices, wherein historic usagedata indicates one or more of the following: a combination of the one ormore wearable devices that are utilized in the historic usage patterns,locations where the one or more wearable devices are utilized in thehistoric usage patterns, and dates or times where the one or morewearable devices are utilized in the historic usage patterns; programinstructions, in response to a determination that a current usagepattern of a user is indicative of the expected usage patterns of theone or more wearable devices, to compare a current position pattern ofthe one or more wearables devices to the expected position pattern;program instructions, in response to the current position pattern notmatching the expected position pattern, to retrieve an overlaycorresponding to a use case indicated by the expected usage pattern; andprogram instructions to render the overlay in the augmented realitydevice, wherein the overlay is rendered in the expected position patternfor the one or more wearable devices relative to the view of anaugmented reality device.
 9. The computer program product of claim 8,wherein the expected position pattern is a vector-based map thatindicates an expected position and an expected direction of the one ormore wearable devices.
 10. The computer program product of claim 9,wherein program instructions to compare the current position pattern ofthe one or more wearables devices to the expected position patternfurther comprises: program instructions to compare a current position ofthe one or more wearables to the expected position indicated by thevector-based map; and program instructions to compare a currentdirection of the one or more wearables to the expected directionindicated by the vector-based map.
 11. The computer program product ofclaim 8, the program instructions further comprising: programinstructions to identify a missing wearable device based on thecomparison of the current position pattern of the one or more wearablesdevices to the expected position pattern; program instructions toretrieve an augmented reality overlay interface associated with themissing wearable device; and program instructions to render theaugmented reality overlay interface associated with the missing wearabledevice.
 12. The computer program product of claim 8, the programinstructions further comprising: program instructions to identify amissing wearable device based on the comparison of the current positionpattern of the one or more wearables devices to the expected positionpattern; program instructions to retrieve an augmented reality overlayinterface associated with a function of the missing wearable device; andprogram instructions to render the augmented reality overlay interfaceassociated with the function of the missing wearable device.
 13. Thecomputer program product of claim 8, wherein the current positionpattern is determined based on at least one image captured by theaugmented reality device.
 14. The computer program product of claim 8,wherein the current position pattern is determined based on a respectivesignal strength of a connection between the one or more wearable devicesand the augmented reality device.
 15. A computer system comprising: oneor more computer processors; one or more computer readable storagemedia; and program instructions stored on the computer readable storagemedia for execution by at least one of the one or more processors, theprogram instructions comprising: program instructions to identify anexpected position pattern of one or more wearable devices based onhistoric position data of a user regarding the one or more wearabledevices; program instructions to identify an expected usage pattern ofthe one or more wearable devices based on historic usage data of theuser regarding the one or more wearable devices, wherein historic usagedata indicates one or more of the following: a combination of the one ormore wearable devices that are utilized in the historic usage patterns,locations where the one or more wearable devices are utilized in thehistoric usage patterns, and dates or times where the one or morewearable devices are utilized in the historic usage patterns; programinstructions, in response to a determination that a current usagepattern of a user is indicative of the expected usage patterns of theone or more wearable devices, to compare a current position pattern ofthe one or more wearables devices to the expected position pattern;program instructions, in response to the current position pattern notmatching the expected position pattern, to retrieve an overlaycorresponding to a use case indicated by the expected usage pattern; andprogram instructions to render the overlay in the augmented realitydevice, wherein the overlay is rendered in the expected position patternfor the one or more wearable devices relative to the view of anaugmented reality device.
 16. The computer system of claim 15, whereinthe expected position pattern is a vector-based map that indicates anexpected position and an expected direction of the one or more wearabledevices.
 17. The computer system of claim 16, wherein programinstructions to compare the current position pattern of the one or morewearables devices to the expected position pattern further comprises:program instructions to compare a current position of the one or morewearables to the expected position indicated by the vector-based map;and program instructions to compare a current direction of the one ormore wearables to the expected direction indicated by the vector-basedmap.
 18. The computer system of claim 15, the program instructionsfurther comprising: program instructions to identify a missing wearabledevice based on the comparison of the current position pattern of theone or more wearables devices to the expected position pattern; programinstructions to retrieve an augmented reality overlay interfaceassociated with the missing wearable device; and program instructions torender the augmented reality overlay interface associated with themissing wearable device.
 19. The computer system of claim 15, theprogram instructions further comprising: program instructions toidentify a missing wearable device based on the comparison of thecurrent position pattern of the one or more wearables devices to theexpected position pattern; program instructions to retrieve an augmentedreality overlay interface associated with a function of the missingwearable device; and program instructions to render the augmentedreality overlay interface associated with the function of the missingwearable device.
 20. The computer system of claim 15, wherein thecurrent position pattern is determined based on at least one imagecaptured by the augmented reality device.